Predictability of measurements 
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The second law of thermodynamics states that entropy increases (or does not change) by time 
in an isolated system. As microscopic physical laws are reversible, the origin of irreversibility is 
not straightforward. Although the outcome of a measurement on a pure quantum state is not fully 
predictable due to the Heisenberg uncertainty principle, quantum and finite entropy uncertainties 
are thought to be fundamentally different. We propose to calculate the predictability of measure- 
ments comprising both quantum and entropic uncertainties. We show that the unpredictability of 
measurements is identical to entropy in case of semiclassical statistical mechanics, and it increases 
by time in a pure entangled quantum state as a result of quantum measurement. 
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Entropy, a central quantity of statistical physics calcu- 
lated from the probability of possible states is a widely 
accepted measure of information content. It is also con- 
sidered to be a measure of disorder or rather the amount 
of information unavailable for the theory describing the 
system. Thermodynamic definition of entropy is ascribed 
to Clausius. Statistical explanation of entropy based on 
the microscopic components of a physical system was laid 
down by Boltzmann. von Neumann defined the entropy 
of quantum systems by changing classical microscopic 
states to quantum states resulting in zero for pure states. 
In information theory a similar measure to physical en- 
tropy was introduced by Shannon. Throughout this pa- 
per, for the sake of simplicity, we calculate entropy with 
logarithm to base 2 and without the Boltzmann constant. 
Instead of the probabilistic definition of entropy, algo- 
rithmic randomness measuring the information content 
of individual microstates was proposed to be applied in 
physics by Zurek [l[ . 

Second law of thermodynamics stemming from the 
early work of Carnot and Clausius states that entropy 
increases (or does not change) by time in an isolated sys- 
tem. This law breaks the symmetry of time. As mi- 
croscopic physical laws are reversible, the origin of irre- 
versibility is not straightforward. (See Q and references 
therein.) 

Quantum measurement according to von Neumann can 
be described by a projection in the Hilbert space to an 
eigenstate of the operator representing the quantity be- 
ing measured. The measurement problem, i.e., how the 
projection happens is still not fully resolved. Studies of 
quantum decoherence attempt to give a probabilistic ex- 
planation Q. The measuring process itself is not dis- 
cussed in this paper. 

The famous EPR paradox Q introduced by Einstein, 
Podolsky and Rosen points out the peculiar feature of 
quantum measurement on entangled particles. Bohm and 
Aharonov gave both theoretically and experimentally 
simpler example of the EPR paradox Q with two spin- 



1/2 particles in a singlet state. This state is isotropic, 
i.e., measuring the spin of one particle along an arbitrary 
direction infers opposite spin for the other particle along 
the same direction. Considering the spin and the spatial 
part of the single particle states, the initial two-particle 
state of the EPR paradox can be described by the follow- 
ing antisymmetric ket vector in the center-of-momentum 
frame: 
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where \a) and \j3) are the Zeeman eigenstates of the 
spin operator (I z ) with +1/2 and —1/2 eigenvalues; (\+p) 
and (|— p) are representing the spatial parts of the single 
particle states with momentums +p and — p, respectively. 
Assuming that one of the distant observers measures I z 
of the particle moving towards her with a momentum of 
+p, and finds +1/2, the final, still antisymmetric state 
of the two-particle system, according to her, will be as 
follows: 
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Bell showed that the introduction of further hypothet- 
ical, so called hidden variables to amend the description 
given by quantum mechanics cannot solve the EPR para- 
dox According to Bell one should make do with the 
predictions of quantum mechanics with no hope of a more 
complete theory. 

In physics there is to be a tight correspondence be- 
tween the abstract objects of theories and observable 
quantities (shortly observables) . The correspondence, 
however, is never perfect. Both in statistical and quan- 
tum mechanics the output of measurements can be pre- 
dicted only with some uncertainty due to finite tempera- 
ture and Heisenberg uncertainty, respectively. These are 
usually taken into account by introducing noise, i.e., ran- 
dom parameters into the theoretical models. 
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The concept that entropy is calculated from the proba- 
bilities of possible theoretical states (mathematical mod- 
els) is very reasonable if all the observables can be de- 
duced from the model. In quantum systems it is not the 
case according to the Copenhagen interpretation devised 
by Bohr and Heisenberg. 

We propose a more pragmatic definition to measure 
the uncertainty content of a system: the amount of ob- 
servable information hidden from the environment. This 
is closely related to the predictability of possible mea- 
surements. To calculate the unpredictability (P) of a 
measurement we need to count the possible outcomes 
(with equal probabilities) and convert this number to a 
logarithmic scale as we claim additivity for independent 
systems: 

P = I092N, (3) 

where N denotes the number of possible outcomes of 
the measurement. If the outcomes are not equally prob- 
able, we need to use the formula: 

P = -^Pilog 2 Pi, (4) 

i 

where pi denotes the probability of the i th outcome. If 
more than one independent observables can be measured, 
one should consider all the possible outcomes with prob- 
abilities pij : 

P = -^2pijlog 2 pij, (5) 

i,j 

where i indexes the outcome of the j independent 
observable. Independent means that there is no theo- 
retical correlation between these observables, e.g., the x 
and y components of the spin (I x and I y ) of a spin-1/2 
particle are independent in the \a) state. It has to be 
emphasized that not all the independent observables can 
be measured simultaneously due to the Heisenberg un- 
certainty principle. Nevertheless, the formula above still 
can be reasonable. 

In semiclassical statistical mechanics each microscopic 
state of the system corresponds to a set of possible values 
of observables, e.g., the momentums and coordinates of 
particles. Knowing the state means that one knows the 
values of observables. This relation leads to the equality 
between unpredictability of measurements and entropy. 
In case of a single observable using Eq. (|3j) or (|4j) this is 
trivial. In case of multiple independent observables the 
probability of the k th state, X% is the product of proba- 
bilities of the values of observables defining the state: 

P( X k) = Y[p<x(k,j),j, (6) 

3 



where a(k,j), a function of k and j indexes the value 
of the j th observable in the X k state. The sum of the 
probabilities of those states that implicate the i th out- 
come of the j th observable results in the probability 
introduced in Eq. ([5jl: 

Pij = S,P(Xk)8 i>a (k,j), (?) 
fc 

where 5 stands for the Kronecker delta. Entropy of the 
system: 

S = -J2p(Xk)lo 9 2P(X k ). (8) 

fc 

Equations ©, ©, ©, and (0) deduce 

S = P. (9) 

Unpredictability of measurements on a single spin-1/2 
in a pure quantum state is 2, as two components of the 
spin are uncertain with 2-2 possible outcomes and 1/2 
probabilities. For instance in the \a) state the measure- 
ment of either I x or I y has two equally likely outcomes. 
The von Neumann entropy of this state is 0. In a mixed 
state of I a) and |/3) with 1/2-1/2 probabilities the von 
Neumann entropy is 1. In this state all three compo- 
nents of the spin are totally uncertain. Accordingly, un- 
predictability results in 3. The difference in the infor- 
mation content of the pure and mixed states is equally 
1 calculated either using the von Neumann entropy or 
unpredictability of measurements. 

Measuring the spin of a single spin-1/2 particle in the 
I a) state along an arbitrary axis will not change the pre- 
dictability of the system, as it remains 2. The von Neu- 
mann entropy is also unchanged. 

However, unpredictability increases in an EPR exper- 
iment after the measurement. In the initial state de- 
scribed by Eq. (jTJ) it is 3 as the number of independent 
observables with 2-2 possible outcomes and 1/2 proba- 
bilities is 3. Although all three components of the single 
particle spins are uncertain, spin components of one par- 
ticle can be deduced from the values of the other particle. 
In other words, the total number of uncertain observables 
is 6 but there are also 3 correlations between them. In the 
final state unpredictability has been increased to 4 with 
4 independent uncertain observables: I x and I y of both 
particles. The increase in unpredictability is accompa- 
nied by the loss of correlation between these observables. 

If the two measuring apparatus of the EPR experiment 
is modeled by two additional spin-1/2 particles in an ar- 
bitrary initial state and in a final state similar to the 
final state of the measured particle we can calculate the 
change in predictability for the full system including the 
measuring particles. Measuring particles are considered 
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to be not entangled with the EPR particles (singlet pair 
of particles) before and after the measurement. As the 
predictability of the measuring single particles are un- 
changed we find that the predictability of the full system 
also decreases due to the measurement. 

In case of observables described by continuous vari- 
ables unpredictability can be infinite assuming an in- 
finitely precise measurement. As in reality measurements 
are not infinitely precise, the change in unpredictability 
is finite even in case of continuous physical quantities. 

Although an abstract quantum state may be the very 
best model of a physical system described by an observer 
according to Bell |6j, it may still not be identical to re- 
ality. Abstract models are constructed by observers on 
the basis of information relating the physical system ob- 
served. Some observers may have less information than 
others. Entropy may be attributed to conflicting models 
compatible with different (possible) observers. A quan- 
tum system before and after the measurement is de- 
scribed by different states that cannot be merged into one 
coherent time-dependent quantum state. Similar applies 
to the models constructed by the two distant observers 
in the EPR experiment. One of them already has /) 



in mind, while the other is unable to update \^>i) lacking 
the information of the measurement. 

Theory of Relativity states that the direction of in- 
formation flow cannot be space-like, i.e., a message can 
be transferred only to the future not to the past. Con- 
sequently a process accompanying the flow of informa- 
tion is also time-like. If the measurement process, i.e., 
the information flow from the measured system to the 
measuring instrument is accompanied by the increase of 
unpredictability, it may lead to the second law of ther- 
modynamics. 
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